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0 -OptimaJ-  Second  Order  Designs  for  Symmetric  Regions 
D 

By  L.  Pesotchinsky 


1.  Introduction. 

At  first  we  m.ust  refer  to  the  paper  of  Kiefer  (1975 emphasizing  the 

problem  of  examination  of  structure  and  performance  of  competing  designs 

under  various  changes  of  criterion.  As  an  illustration  such  a study  was 

successfully  completed  in  that  paper  for  a family  of  $ -optimality  criteria, 

P 

that  included  the  three  most  commonly  used  criteria,  those  of  D-,  A-  and 
E-optimality,  with  respect  to  quadratic  regression  on  the  m-simplex.  In  the 
papers  of  Galil  and  Kiefer  (l977a,b)  the  study  was  also  completed  with  respect 
to  rotatable  designs  on  a ball  and  optimal  designs  on  a cube. 

The  family  of  criteria  considered  is  produced  by  optimality  functionals 
derived  from  the  N x N information  matrix 

M(|)  = J f'(x)  f(x)  |(dx)  , 

"x 

where  N is  the  number  of  unknown  parameters,  | is  the  design,  that  is, 
in  general,  a probability  measure  over  experimental  region  X,  and  f is 
the  known  regression  function  (f^(x), . . . ,fj^(x)*).  The  corresponding  model 
is  supposed  to  be  of  a linear  form;  EY  = 0f ’ , where  Y is  the  response 
function  and  IT  coefficients  0 are  unknown.  We  also  assume  that  the 
observations  of  Y are  vincorrelated  and  with  the  equal  variances.  If  in 
case  of  nonsingular  information  matrix  ^ denote  the  eigen- 

values of  M(|),  then  the  functionals  $ (| ) are  defined  as  follows: 

P 
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$ (l)  = [N"^  tr  ^ . 0 < p < 00  ^ 

^ i=l 

(1.1)  <I>q(0  = li“i  M~^(|))^^^  :, 

p -♦  0+  ^ 

® (l)  = lim  = max  (|i7^(|)}  ; 

°°  p->  + oo^  l<i<N 

<l>„^  and  ^ are  the  familiar  D-,  'A-  and  E-optimality  criteria. 
A $^-optimal  design  |*  is  one  that  minimizes 

In  the  above  mentioned  papers  of  Galil  and  Kiefer  it  was  noticed  in 
particular,  that  on  the  \init  ball  and  the  simplex  the  ^^-optimal  designs 
(from  a class  of  rotatable  ones  if  on  the  ball)  were  fairly  efficient 
relative  to  the  other  designs  of  the  same  family,  which  was  not  the  fact 
on  a cube. 

We  consider  in  this  paper  the  same  family  of  criteria  with  respect 
to  quadratic  regression  on  the  unit  ball,  on  a cube  = [-1,1]^  and  on 
a cube  with  the  vertices,  truncated  by  planes  X denoted 

further  as  a region 

m 

Sj^(k,a)  = n (x|  ^ |x^|  < k+a}  , 

i=l 

where  integer  k e [l,m-l]  «and  0 < a < 1.  One  of  the  reasons  for  the 
artificial  in  some  sense  choice  of  polyhedrons  S2^(k,a)  is  that  they  can 
serve  as  an  approach  in  experimental  problems  when  a region,  if  presented 
as  a cube,  has  iinattainable  vertices,  becaxise  the  trials  at  them  or  near 
them  are  either  expensive  or  too  complicated.  The  next  reason  is  that 
the  main  details  of  study  on  S^(k,a)  follow  from  the  study  on  a cube  and 
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that  $ -optimvim  designs,  as  it  is  shown  in  sections  3 and  4,  are  often 
P 

unique  on  a^(k,a)  with  the  same  set  of  support  for  all  p and  are 
"good"  even  for  a cube  C^.  The  same  reasons  hold  for  the  regions 

m 

Q.  (k,a;n,b)  = G fl  {xjn-l+b  < ^ jx.  | < k+a] 

i=l 

when  the  center  point  is  also  unattainable. 

In  the  paper  the  main  attention  is  paid  to  the  study  of  stmcture  of 
the  supports  of  the  $^-optimal  designs  over  Q^(k, a)  and  the  unit 

ball  (in  the  latter  case  with  respect  to  all  the  designs)  both  under 
variation  of  p and  transformation  of  region  (the  latter  mainly  in  the 
sense  of  variation  of  k+a  in  Q^(k,a)  with  m fixed). 

There  is  some  regularity  to  be  expected  in  behavior  of  the  O^-optimal 
supports  \inder  fixed  experimental  region  and  with  p changing,  so  the  study 
of  both  "extreme"  cases  p = 0,  oo  is  of  special  interest,  also  because 
it  can  be  done  algebraically.  By  such  direct  methods  we  can  obtain  some 
general  results  for  the  case  of  a ball  of  arbitrary  radius,  as  well  as  for 
the  study  of  uniqueness  and  structure  of  the  $ -optimal  supports  for  all  p. 
These  problems  are  considered  in  section  3.  In  other  parts  of  this  section 
we  study  the  asymptotical  robustness  of  the  D-  and  E-optimum  designs  under 
changes  of  p with  m ->  oo  . 

The  numerical  results  on  structure  in  the  case  0 < p < oo  as  well 
as  the  results  on  the  performance  of  the  designs  with  respect  to 

various  criteria  are  illustrated  in  section  4. 
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In  section  5 an  attempt  is  made  to  construct  some  integer  designs 

on  the  cube  and  the  unit  ball  which  are  uniformly  "good"  with  respect 

to  the  family  of  the  -optimality  criteria. 

P 

As  well  as  criteria  of  the  $ -family  we  consider  here  the  criterion 

P 

of  G-optimality  with  the  optimality  functional 

G(|)  = max  d(x,|)  = max  f(x)M"^(^)f'  (x) 
xeX  xeX 

where  d(x,  5)  for  nonsingular  M(|)  is  the  normalized  variance  function 

of  the  regression  function  fitted  by  least  squares.  The  original  equivalence 

theorem  (Kiefer  and  Wolfowitz,  I960)  asserts  that  G-optimality  is  equivalent 

to  I®- -optimality  and  that  max  d(x,  = N.  One  of  the  conclusions  of 
^ X€X  ^ 

the  study  on  the  regions  in  this  paper  is  that  the  high  'I>^-efficiency  of 
s (and  especially  of  §*)  does  not  imply  the  high  G-efficiency,  as 
it  was  in  the  case  of  the  m-simplex  (Kiefer^  1975 )• 

2.  Definitions  and  Notation. 

For  simplicity  we  shall  define  the  ^^-efficiency  of  | as  the  ratio 

^>p  (5*)/'J>p  (| ),  denoted  further  as  thus  for  p = 0 we  obtain  the 

D-efficiency  of  Atkinson  (1973).  The  G-efficiency  of  5 is  defined  as 

the  ratio  g(|)  = N/d(5),  where  d(|)  = max  d(x, |). 

xgX 

We  will  consider  mainly  the  values  of  eg^(|*)  and  g(^*)^  so  for 
brevity  they  will  be  denoted  as  ®q(p)  and  g(p)  correspondingly. 
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We  examine  here  second  order  regression  on  symmetric  regions,  so 
the  limiting  axgutnents  similar  to  those  in  papers  of  Kiefer  (1974,1975) 
and  Farrell  et  al.  (19^7 ) may  be  implemented  to  reduce  the  problem  and 
consider  only  invariant  ®p-optimum  designs;  that  is  in  our  case,  designs 
invariant  under  permutations  of  indices  and  changes  of  signs  of  the  design 
points  coordinates.  In  general,  even  on  a ball,  orthogonal  transformations 
preserve  only  D-optimality  of  the  designs;  thus  we  shall  consider  only  the 
above  invariance. 

If  ^ is  an  invariant  second  order  design,  then  M(^)  depends  only 
on  the  even  moments 


Xg  = E(x^),  4^  = E(x^x^),  = E(x^) 


(1  < i,  0 < m) 


and  the  odd  moments  are  zero.  These  conditions  on  moments  are  also  valid 
for  noninvariant  second  order  symmetric  designs,  as  defined  by  Kono  (1962), 
so  we  shall  not  further  underline  the  difference  between  invariant  and  non- 


invariant designs  with  the  same  information  matrix,  and  shall  call  both 
types  of  them  "symmetric  designs".  E.g.,  the  second  order  symmetric 
D-optimum  designs  on  the  cube  in  the  papers  of  Kiefer  (1961)  and  KSno 


(1962)  are  invariant  and  the  same  designs  in  the  papers  of  Farrell  et  al. 

(1967)  and  Pesotchinsky  (1975)  are  noninvariant  with  m > 3* 

Throu^out  this  paper  E denotes  the  set  of  points  of  the  3°^  factorial, 
divided  into  m+1  sets  E with  the  k-th  set  consisting  of  all  2 ml/k!  (m-k)l 


points  with  k nonzero  coordinates;  and  for  the  unit  ball  E^^  denotes  the  set 
of  all  points  with  k coordinates  equal  to  + l/\/k  and  m-k  equal  to 
zero;  E = note  that  if  e:  E^^)  is  the  set  of 
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support  of  a second  order  S3nBmetric  design  on  a cube,  then  the  corresponding 
set  of  a ball  also  supports  some  symmetric  design,  because  both  sets  differ 
only  in  value  of  levels  of  factors.  Thus  the  problem  of  study  of  structure 
of  supports  of  the  designs  over  points  of  E on  a ball  can  be  reduced  to 
the  same  problem  over  points  of  E on  a cube,  thou^  the  optimal  weights 
are  different. 

In  the  following  E^  will  denote  3-^^  E^(k, a)  — the  set 

of  vertices  of  the  polyhedron  a)  — the  points  with  k coordinates 

equal  to  + 1,  one  equal  to  + a,  and  m-k-1  equal  to  zero,  and  B^(k,a)  — 

the  set  of  points  with  all  coordinates  equal  to  + (k+a)/m.  (if  k+a  = m, 

then  B (k,  a)  = E (k,  a)  = E and  if  a = 0,  then  the  set  E (k,a) 

coincides  with  E,  ).  The  union  of  all  the  above  sets  will  be  denoted  as 
k 

R (k,a);  R (k,a)  = E J U E (k,a)  U B (k,a)  . 

3*  Main  Theoretical  Results. 

3.1  The  sets  of  support  and  uniqueness  of  O^-optimal  designs. 

It  follows  from  the  General  Equivalence  Theorem  (G.E.T. ) (Kiefer, 

197^  that  ^ is  $ -optimal  for  0 < p < oo  if  and  only  if  for  all  xeX 

E 

(3.1)  M ^ (x)  < tr  Cm  ^(i)} 

and  that  an  optimal  | assigns  measure  one  to  the  set  of  x for  which 

equality  holds  in  (3.1).  d^(s)  in  (3.1)  is  a quartic  in  x,  and  for 

I 

ssrmmetric  second  order  | 
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(3.2) 


m o “ k ^ o o 

d (x)  = A + B X X + C £ X + D(  £ X ) 

^ i=l  i=l  i=l 

where  A,  B,  C,  D are  the  functions  of  p. 

It  can  be  proved  in  the  same  way  as  for  D-optimum  designs  in  the  paper 

of  Farrell  et  al.  (1967),  that  with  all  p < co  -optimum  second  order  designs 

on  a ball  must  be  supported  by  points  of  the  sphere  of  the  same  radius 

and  the  center  point.  As  to  X = a),  then  the  maximizing  points 

of  (3.2)  must  belong  to  the  set  R (k,a). 

m 

Moreover,  suppose  that  the  points  of  three  sets  ^ “ 1^2, 3^ 

give  maximum  to  d^(x)  for  some  fixed  p.  (These  sets  can  belong  to 
the  supports  of  different  -optimal  designs,  not  necessarily  to  the  same). 
Then  we  have  in  the  case  of  quadratic  regression  that 


(3.3)  A + Bk.  + Ck  + Dk?  = A + Bk 


+ Ck.  + Bk 


and  thus 
and  this 
as  those 
1) 


2) 


D(k^-k2)(k^-k^)  = 0,  B+C  = -D(k^+k^).  So  D = 0 and  B = -C 
fact  implies  that  all  the  points  of  E have  the  same  property 
of  E,  . From  this  fact  we  can  derive  that: 

H 

A $ -optimal  design  for  Q (k,a)  is  also  $ -optimal 

p P m P 

for  cube  C^,  because  in  this  case  d^(x)  = A in  points  of 

E,  where  all  the  possible  supports  of  il>  -optimal  designs  must 

P 

be  contained.  By  G.E.T.  it  means  that  the  design  is 

<I>  -optimal  for  cube; 

P 

|*CE  (k,a)}  = 5*{B  (k,a)},  this  follows  from  p.  1)  because  both 
P ^ pm 

E^(k,a)  and  B^(k,a)  must  not  be  contained  in  the  supports  of 
<I>  -optimal  designs  for  cube; 

Jc 
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5)  AO  -optimal  design  on  a cube  is  nonunique  if  m > 3^  that  is 
!P 

at  least  two  "basic"  0^-optimal  designs  exist  supported  by 
different  groups  of  at  most  three  sets  U U . It 

simply  follows  from  the  fact  that  the  system  of  three  linear  equa- 
tions for  the  moments  of  O^-optimal  measure,  the  same  system  as  in 
the  paper  of  Pesotchinsky  (1975)^  includes  m+1  wei^ts  of 

sets  E^,  k = 0,1,..., m,  and  thus  the  existence  of  one  solution 
implies  the  existence  of  the  others. 

On  the  other  hand,  if  k+a  < m and  only  two  sets  E,  , E,  belong 

ki  kg 

to  the  support  of  the  <I)  -optimum  design,  then  we  can  show  as  above  in  (3.3) 

P 

that  for  any  integer  r,  r < k,  D(k^-.r)(k2-r)  < 0,  thus  k^  = 0 and  kg  = k 
and  the  <I)p-optimum  design  is  unique  on  a^(k, a).  (We  do  not  consider  here 
the  possibility  of  reduction  of  number  of  points  of  support  with  the  help 
of  noninvariant  designs. ) 

The  above  reasoning  suggest  the  procedure  of  theoretical  or  mmierical 

study  of  $p-optimal  designs  for  a^(k,a)  with  0 < p < oo:  for  each  m 

we  shall  find  the  "basic"  *^-optimal  designs  for  the  cube  let 

k^(p)  ke  the  minimum  of  k^'s  for  "basic"  O^-optimal  designs  supported 

by  at  most  three  sets  ^ ^ £ ^2  — ^3^  then  the  main 

12  3 

result  for  the  study  is  given  in  the  following  Lemma. 


Lemma.  If  k > k^(p),  then  the  ^^-optimal  design  on  2^(k,a)  can  be 
presented  by  at  least  one  of  the  0^-optimal  designs  on  a cube,  and  if 
k < k^(p),  then  the  O^-optimal  design  on  Q^(k,a)  is  unique  and  its  set 
of  support  is  contained  in  E^  U E^(k,a)  U E^  U B^(k, a);  moreover,  the 


m 


optimal  weights  of  E^  and  Ejjj(k,a)  are  both  nonzero. 
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This  result  will  be  used  further  in  3-2  and  3-3  for  the  study  of 
D-  and  E-optimm  designs. 

We  can  also  note,  that  if  n (p)  denotes  the  maximum  of  k, ’ s for 

m 1 

"basic"  $p-optimal  designs  on  a cube,  then  the  $p-optimal  design  for 
region  S2^(k,a;  n,b)  is  unique  provided  that  the  condition 
lijj(p)  < n < k < k^(p)  does  not  occur  and  the  set  of  support  of  such 
design  is  contained  in  B^(n-l,b)  U Ej^  U E^(k, a). 

All  the  results  above  were  valid  for  0 < p < oo,  the  case  of  p = oo, 
that  is  the  E-optimality  of  the  designs,  is  studied  algebraically  later 
in  this  section  to  remove  some  difficulties  arising  for  p = oo  in  an 
analogue  of  (3-1)  (Kiefer,  197^ )• 

3 . 2 D-optimum  designs. 

Our  considerations  here  are  limited  to  the  case  X = (k,a), 

because  both  the  D-optimum  designs  on  a cube  and  a ball  were  studied 
in  papers  of  Kiefer  (I961)  and  Farrell  et  al.  (1967)- 

For  the  D-optimum  designs  on  a cube  we  have  that  (Fanrell 

et  al. , 1967);  thus  the  D-optimum  designs  are  unique  on  ft^(k,a)  for 
k+a  < m.  For  p = 0 the  left-hand  side  of  (3.1)  is  the  variance  of  the 
estimate  of  the  regression  function  and  the  right-hand  side  is  the  number 
of  unknown  parameters,  that  is  W = (m+l) (m+2)/2.  The  coefficients  A,  B, 
C,  D in  (3.2)  can  be  found  algebraically  as  functions  of  moments 
and  so  the  condition  (3.1)  is  easy  to  verify. 

We  can  start  the  search  of  the  D-optimum  designs  on  ft^(k, a)  with 
the  D-optimum  designs  |*(k,a)  from  the  class  of  designs  supported  by 
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points  of  E^(k^a)  and  the  center  point.  Maximizing  the  value  of  the 
information  matrix  determinant,  we  obtain  the  weight  Q:^  of  the  center 
point:  cZq  = N for  all  m,  k,  a.  Then  we  verify  the  condition  (3-1) 

at  points  of  and  B^(k,a),  thus  obtaining  that  the  designs  |*(k,a) 

are  D-optim-um  for  the  regions  a^(k, a)  with  2 < k < m-2  (m  > 4)  and 

0 < a < 1.  Verification  of  (3-1)  for  the  designs  |*(k,a)  with  k = 1 

or  m-1  discloses  the  existence  of  such  "critical"  values  a'  and  a" 

m m 

that: 

1)  for  k = 1 and  a > a^  the  designs  |*(l,a)  are  still  D-optinrum 
for  a (l.a)  and 

2)  for  k = m-1  and  a < a^  these  designs  are  D-optimum  for 
fl^(m-l,a). 

The  values  of  a'  and  a"  are  independent  for  m > 3j  but  for 
m = 2 we  have  (l-a2)/(l+a2)  = a^J  this  can  be  proved  even  geometrically 
because  the  45°  turning  of  Q.^{±,a.)  with  suitable  normalization  gives 
us  the  region  where  a,b  are  in  the  same  relation  as  a^  and 

ag  above. 

a^  can  be  found  by  solving  the  equation  d^(x)  = N at  x e B^(l,a^), 
^ ~ 4>y  solving  the  same  equation  at  x e 

1 = |Q(m-l,a^).  Both' the  left-hand  sides  of  the  equations  can  be  reduced 
respectively  to  polynomials  of  powers  12  and  8 with  at  most  one  root 
on  (0,1).  In  particular,  from  the  second  of  them  we  have 

(a")^(-m^+7m-9)  + Y Pv'a")^^  = 0, 

k=2 

where  s depend  only  on  mj  that  gives  us  0 m >6. 

a'  and  a"  are  listed  in  table  1. 
m m 
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Table  1. 


The  critical  values  a'  (for  Q (ija))  and 

m m 

a"  (for  Q (m-l,a)). 
m ^ m ^ " 


m 

2 

3 

4 

5 

6 

7 

8 

a’ 

m 

0.234 

.171 

• 

H 

0^ 

VD 

.163 

.157 

.151 

Lf^ 

H 

• 

a" 

m 

0.621 

.476 

.332 

.150 

0 

0 

0 

To  complete  the  study  of  the  D-optimum  designs  on  ^2^(k,a)  we  can 
note  that  in  the  case  k = m-1  and  for  a increasing  beyond  a^  the 
set  of  support  of  the  D-optimura  design  must  be  supplemented  by  the  set 
and  in  the  case  k = 1 and  0 < a < by  the  set  Bj^(l^a); 
thus  the  following  theorem  holds. 

Theorem  1.  The  D-optimum  designs  for  quadratic  regression  on  Qj^(k,a)  are 
supported  by  the  center  point  and  with  respect  to  values  of  k^a  by  the 
following  sets: 

1)  E (k,a):  (i)  for  k = 1 and  a > a' , (ii ) 2 < k < m-2, 

m — m — — 

(iii ) k = m-1  and  a < a"  : 

2)  E^(l,a)  and  B^(l,a):  for  k = 1 and  0 < a < a^  ; 

3)  Ejj^(m-l,a)  and  E^  for  k = m-1  and  a^  < a < 1. 

We  should  note  that  the  optimal  moments  and  are  the 

functions  of  weights  of  sets  B (l.a),  E (m-1, a)  and  E ^ , so  these 

m m^  m-1' 

wei^ts  under  m,  k,  a fixed  could  be  found  by  direct  maximization  of 
det  . 

I 
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We  can  note  that  the  points  of  E^(k,a)  belong  to  a sphere  of 
radius  k+a  and  I^Ck^a)  assigns  to  this  sphere  the  same  measure 
m(m+3 )/{ (m+l)  (m+2)}  as  the  D-optim-um  design  on  a ball  (Kiefer^  I961). 

Hence  we  expect  that  the  designs  |Q(k,a)  have  good  D-efficiencies 
relative  to  a ball. 

For  instance  the  D-efficiency  of  ^^(k^O)  on  a ball  of  radius  k 
(this  efficiency  is  denoted  further  by  f^(k))  varies  as  a function  of 
k € [2,m-l]  from  up  to  1 (at  k = (m+2)/3)  and  then  to  f^(m-l). 

We  have  that  f (2)il/2  and  f (m-l)t  1 as  m -»  00  : the  minimum  value  of 
f (m-l)  is  0.787  at  m = 11  and  f (2)  > O.829  for  m < 11.  Also 

HI  m — 

the  estimations  show  that  the  D-efficiency  of  |*(k^0)  relative  to  the 
"langer"  region  $2^(n,0)  (k  < n < m)  is  more  than  k/n  and  that  |*(lja) 
is  fairly  D-efficient  even  in  cases  when  O.05  < a < a^.  It  turns  out 
from  these  remarks,  as  well  as  from  the  evident  remark  that  |*(k,a)  is 
invariant  under  truncation  of  cube  vertices  in  points  of  E^(k,a)  by 
any  concave  (to  the  center  point)  surface,  that  the  designs  |*(k,a) 
are  somewhat  robust  in  their  D-efficiency  under  variation  of  experimental 
region. 


3 .3  E-optim\im  designs. 

The  result  for  cube  was  independently  obtained  by  V. K.  Denisov  and 
A.  A.  Popov  of  Novosibirsk  (not  yet  published),  Galil  and  Kiefer  (1977b) 
and  the  author.  For  details  we  can  refer  to  the  paper  of  Galil  and 
Kiefer  (1977b),  and  here  we  can  mention  briefly  that  the  E-optimum  design 
on  a cube  has  moments  = \^  = 2/5,  = l/5  (independently  of  m). 
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Wfe  can  easily  find  that  the  basic  solution  of  the  equations  for  moments 
exists  for  the  wei^ts  of  sets  , i = 1,2,3^  iff 


(3  A) 


0 < < {2mkj-m(m+l))/(5kj-2m)  < k^  < 

< {m(m+l)-2mk^)/  (2m-5k^)  < k^  ^ 


so  we  can  find  that  for  the  E-optimum  design  (p  = oo)  = (m+l)/2 

for  odd  m and  m/2+1  for  even  m and  is  the  integer  part  of 

(m-l)/3.  It  is  also  of  interest  that  basic  solutions  with  two  nonzero 
components  exist,  as,  e.g.,  with  k^  = k^  = 0 and  k^  = with 

odd  m. 

Taking  into  account  the  fact  that  k^(p)  decreases  with  p,  we 
can  note  that  all  ^^-optimum  designs  are  unique  on  S^(k,a)  iff 
k < (m+l)/2.  On  the  other  hand,  it  means  that  for  good  (in  the  sense 
of  <I)  -optimality)  designs  on  a cube  the  minimum  of  maximal  distance  of 
the  design  points  from  the  center  point  shoiiLd  never  be  less  than  (m+l)/2. 

In  the  case  k < "the  E-optimum  designs  on  a^(k, a)  can  be 

found  by  the  same  reasoning  as  for  the  cube.  E.g.,  if  a = 0,  we  have  that 
I*  is  supported  by  points  of  E^  U with  (Ej^)  = m (m-1 ) (km-2k+l )/ 
/[k{  (k-l) (km-2k+l)  +m(m-l)^)]. 

For  the  study  on  the  unit  ball  we  shall  note  that  the  moments  of 
invariant  measure  obey  the  following  equalities: 


(3.5) 


+ (m-l)X^  ""  ^2  " ’ 


where  cc^  denotes  the  measure  of  the  unit  sphere.  For  the  proof  of 


(3-5)  we  can  consider  the  chain  of  equalities: 
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m “ p 

^2  " ^ ^ E(x^)}/m  = {E(  Y,  = 

i=l  i=l 

^ p p ^ li  p p 

= (E(  ^ X.)  }/m  = (E(  ^ X.  ) + E(  y x.x  ))/m  = 
i=l  ^ i=l 

= {mXj^  + m(m-l)A.j}/m  = \^  + (m-l)A.^  . 

Thus  we  have  for  the  only  five  distinct  eigenvalues  of  M(|): 

j 2 2 

hi  = 1^2  hj  = fl+^2  ■'v(l->^2^  +hmK^/2  , 

= 1+^2 “^3  h^  = ^2  ^ 

and,  taking  into  account  the  uniqueness  of  solutions  of  the  equations 

ia.  = |i.  (l  < i,j  < 3),  we  obtain  in  the  same  way  as  for  the  cube  the 
1 3 

E-optlmum  values  of  \y 

= (m+1 )/ (m^+2m+2 ) , X^  = X^/ (m+1 ) . 

Now  we  have  for  the  ball  that 

2 _i 

(3.6)  maxmln((j^}  = X^  = (m  +2m+2) 

2 

and  the  E-optimum  measure  of  the  unit  sphere  is  a (oo)  = m(m+l)/(m  +2m+2). 

s 

The  existence  and  structure  of  finite  supports  over  points  of  E of 
the  E-optimum  measure  follow  from  the  more  general  result  (theorem  2), 
proved  later  in  this  section. 


l4 


3.4  tf>  -optimum  designs  on  a ball. 

!P ^ 

In  this  case  the  more  detailed  description  of  the  0 -optimal  designs  and 
their  properties  can  be  found  algebraically.  For  the  case  of  the  unit  ball  we 
shall  consider  now  the  two  "free " parameters  remaining  from  (3.5)  (both 

depending  on  p for  the  ^>^-optimal  design),  denoting  the  ratio  of  them  by 
r = Thus  the  functional  ^p(l)  he  considered  as  depending 

only  on  values  of  X~  and  r,  and  the  formal  differentiation  of  3>  with 
0 < p < 00  gives  us  the  equations  = 0 for  the  iI>^-optimal 

values  of  r and  X^.  From  the  first  of  them  we  have  r = 

(and  this  is  also  valid  for  p = 0,oo),  and  the  second  can  be  easily  solved 
now  algebraically  (as  for  p = l)  or  numerically.  We  can  prove  that  the 
solution  X2(p)  as  a function  of  p monotonically  decreases  from 
(m+3)/{  (m+l)  (m+2))  at  p = 0 to  (m+l)/(m  +2m+2)  at  p = oo  and  the 
approximate  solution  (to  order  m”^)  of  the  equation  for  X_(p)  is 

el 

^2^1’)  “ j thus  the  (l^-optimal  measure  of . the 

-5 

unit  sphere  ct  (p)  is  approximately  (to  order  m "^ ) equal  to 
s 

P_^2l/(P+l)}/{ml+l/(P+l)} 

for  0 < P < 00. 

If  we  want  to  represent  the  O -optimal  (for  any  p)  measure  over 
points  of  E,  then  we  can  find  the  equations  for  the  moments 


(3.7) 


m 

>^p(p)  = a (p)/m  = ( Y.  a,  (p))/m  , 

^ ® k-1  ^ 

m P 

X.(p)  = [ I (p)k  (k-l)/k^}]/(m(m-l)}  = 


k=2 


m 


{a  (p)  . I (a  (p)/k)3/{m(m-l)}  , 


k=2 
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where  ^j^(p)  denotes  the  'I>^-optimal  weight  of  the  set  ^ ^ £ 

For  basic  solutions  of  (3.7)j  say  o:  (p),  a.(p),  we  have  for  each  p 

■K  0 

(with  ?v.^(p)  = r(p))  that 


m. 


a.  (p)  = ia  , 


where  i^i  are  equals  respectively,  to  k, j or  j,k.  By  positivity 
of  the  solution  we  obtain  that 

k > > j . 

The  latter  condition  on  k, J does  not  depend  on  the  value  of  the 

unit  sphere  measure  o:  (p)j  thus  all  the  0 -optimal  designs  can  be 

s p 

supported  by  points  of  E. 

The  formal  result  is  given  in  the  following  Theorem. 

Theorem  2.  All  the  <Ii^-optimum  designs  for  quadratic  regression  on  a ball 
are  second  order  S3aiimetric  ones  and  can  be  supported  by  points  of  E;  if 
A denotes  the  set  of  support  of  such  a design,  then  the  vector 

P = ( I ^ I (-^  )3  f 

where  A^  = A n E^,  may  be  represented  as  a linear  convex  combination 
of  the  basic  solutions  of  (3.7). 

In  particular,  all  such  designs  can  be  supported  by  points  of 
Eq  U E^  U E^  with  the  <Ii^-optimal  wei^ts,  respectively,  as  follows: 


l6 


1-a  (p),  o;  (p){l-r (p)m},  a (p)r(p)in.  We  can  note  that  for  basic  D-  and 
s s s 

E-optimum  solutions  we  have,  respectively,  that  k > (m+2)/3  > J and 

k > (m+l)/2  > j;  thus  basic  D-  or  E-optimum  designs  exist  over  points  of 

Eq  U Ej^,  where  k is  equal  to  (m+2)/3  (with  m = 3n+l,  n = 0,1,...) 

or  (m+l)/2  (with  odd  m).  Moreover,  only  these  designs  can  be  supported 

by  points  of  one  set  E^  and  the  center  point. 

The  D-optimum  designs  supported  by  points  of  E^  U E^  U E^  were 

constructed  in  the  paper  of  Farrell  et  al.  (19S7),  and  for  m = 7 such 

a design  over  points  of  E^  U E^m^2)/3  constincted  with  the  help 

of  simplex-sum  design  of  Box  and  Behnken  (1960a). 

It  is  interesting  to  compare  the  above  results  with  those  of  Galil 

and  Kiefer  (197Ta),  where  the  $ -optimum  designs  from  the  class  of  rotatable 

F 

designs,  say  ti*(R),  were  considered  on  a ball  of  arbitrary  radius  R. 
Substituting  (3.7)  for  a ball  of  radius  R for 


(5.8)  \^  + (m-l)\j  = R^2 

and  denoting  by  r the  ratio  \j/R  prove  that  O^-optimal 

r(p)  = l/{m+2^'^  for  all  R.  This  fact  implies  that  the  structure 

of  the  cE>^-optimal  designs  over  points  of  E is  also  the  same  for  all  R. 

(E  denotes  now  the  sets  of  points  with  the  coordinates  + R//k  , k = l,2,...,m) 
that  is  that  Theorem  2 is  valid  as  well  as  the  remark  after  it.  The  only 
value  that  changes  with  R is  o:  (p).  E.g. , we  can  find  cl  (00): 
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if 


< m+1 


m (m+1 ) 

(m+1  )^+R^ 

m(E^-l) 

{ (m+E^-l)R^ 

Compared  with  the  corresponding  result  from  the  paper  of  Galil  and 

Kiefer  (1976a)  it  gives  us  the  estimate  of  the  ® -efficiency  of 

00 

ti*(E)  of  order  m 
00 


if  E > m+1 


eff(ii*(E)/|*(E)) 


1-l/m  if  E < m+2 

11  if  E > m+2  . 


Thus  the  rotatable  designs  e*(E)  are  nearly  E-optimum  for  all  R. 

00 

For  p < CO  we  can  exp^ect  the  result  of  the  same  order,  because  the 

designs  ti*(R)  are  D-optimum  for  all  R,  so  a good  performance  is 

provided  for  both  the  extreme  cases  p = 0,  oo. 

We  should  note  also,  that  the  representation  of  the  'I'p-optimal 

measures  over  points  of  E is  not  the  unique  possible  way;  e.g.,  the 

D-optimum  designs  with  m = 2 can  be  supported  by  the  vertices  of  a 

regular  polygon  (with  the  number  of  sides  more  than  4)  and  the  center 

point,  and,  for  arbitrary  m,  by  any  orthogonal  transformation  of  any 

D-optimum  design  over  points  of  E.  (The  latter  is  not  valid  for 

<5  -optimal  designs  with  p > 0,  except  the  trivial  cases  of  permutation 
P 

of  factors  or  change  of  signs  of  them). 
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3-5  Remarks  on  the  efficiency  behavior. 


We  shall  estimate  now  the  values  of  0^(00),  g(oo)  and  for 

large  m on  a cube  or  2^(k,a),  thus  obtaining  some  information  about 

the  "extreme"  cases  of  g(p)  ajid  e (p)  bdiavior. 

Q. 

For  the  D-optimum  designs  on  a cube  or  J2^(k,  a)  the  minimum  eigen- 
value is 


+ 0(m'^)  , 

thus  e(0)-*-0  as  m-^-oo.  For  simplicity  the  calculation  of  e^(oo) 

is  given  in  case  of  odd  m,  when  exists  supported  by  ®0* 

The  D-efficiency  |*  relative  to  the  D-optimum  design  on  H ((m+l)/2,0} 

00  m 

-2 

is  approximately  (to  order  m ) the  ratio  of  weights  on  the  set 
^(m+l)/2^  that  is  4(m+2)/C5 (m+3 )}.  The  D-efficiency  of  the  D-optimum 
design  on  (m+l)/2,0]  relative  to  that  on  a cube  is  approximately  (to 
order  m (m+l)/C2(m-2)),  ilius  e^ioo)  O.k  as  m ■>  00  . Also  we  have 

for  f*  on  a cube  that 

00 


g(oo)  = (m+l)(m+2)(m+5)/{5(ni^+5ni^+^itt+2))  ->  0.2 


as  m 00 


These  calculations  exhibit  the  difficulties  arising  in  the  problem 

of  choice  of  "uniformly  good"  design  on  a cube.  One  of  the  possible 

ways  of  solving  such  a problem  with  respect  to  the  family  , 0<p<oo} 

P 

is  the  search  of  the  design  | which  maximizes  min{e  (|)}  over  q in 
a subset  R c R^  = [0,)  U {00};  the  value  of  g(|)  may  be  also  considered. 

For  R = R_|^  we  can  find  approximate  (to  order  m values  of  moments 
of  the  solution  for  max  min  {e  (|)};  the  moments  of  such  | are  as  follows: 
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= 25/'?h,  Xg  = 7x^/5  and  niin{e^(|)}  = ©^(l)  = X^  (qeR^).  Thoii^ 

for  moderate  values  of  m the  results  are  more  favorable,  as  one  can 

see  in  sections  h,  5,  the  use  of  a compound  criterion  (Kiefer,  197^) 

may  be  more  promising;  an  example  is  given  in  section  if. 

In  case  of  a ball  we  can  use  the  approximate  solution  for  Xg  from 

section  to  estimate  G-,  D-  and  E-efficiencies.  Thus,  we  have  that, 

to  order  m”^,  for  p fixed,  0<p<oo,  e(p)  = ->  0 as 

— 00 

m 00  (and  1 with  m fixed  and  p 00  ; this  is  quite 

natural  because  P*  = lim  e*  as  p -♦oo).  In  the  same  manner  we  find 
that,  for  p fixed,  0 < p < co,  ®q(p)  = l-c(p)/m  -»■  1 as  m -»  00  , 
where  c (p ) depends  on  p . 

For  g(p)  the  result  is  less  favorable:  g(p)  = (to 

order  m ^);  thus  g(p)  j 1/2  as  p 00  . This  result  could  be 
considered  as  somewhat  strange  because  ^^(p)  1,  but  in  the  general 

case,  with  the  help  of  estimations  for  det  M(|)/det  M(|q)  (Kiefer,  196I; 
Fedorov,  1972,  section  2.6)  we  can  prove  that 

(3.9)  ® ^ 

where  e^  = {det  M(|)/det  M(|*)}^'^^  and  g = R/d(|),  so  the  convergence 

-2-B 

of  Oq  to  one  with  departure  of  order,  say  m with  p > 0,  would 

be  sufficient  for  the  convergence  of  g to  one. 

The  estimations  above  show  that  for  the  ball  the  efficiency  behavior 

is  much  better  than  for  the  cube  and  we  can  expect  that  with  m fixed  the 

performance  of  improves  with  p increasing  and  that  with  large  p, 

P 

or  p = 00,  the  ^ -optimum  designs  on  the  ball  -would  be  fairly  efficient^ 

P 
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or  even  robust,  with  respect  to  faxnily  0 < p < oo}j  thus  the 

problem  of  choice  of  "good"  design  would  not  cause  any  difficulty. 

Numerical  Results. 

The  qualitative  study  of  the  behavior  of  structure  of  ^^-optimal 
designs  was  presented  in  section  Z> , so  we  shall  underline  here  some 
main  conclusions. 

The  common  features  of  the  study  on  the  m-simplex  (Kiefer,  1975)  and 
in  other  cases  are  the  changes  in  structure  of  the  designs  with  p increasing, 
althou^  in  the  case  of  the  cube  the  value  of  k^(p)  decreases,  increasing  for 
the  case  of  the  m~simplex,  and  we  have  the  regularity  of  behavior  of  optimal 
wei^ts  for  p fixed  and  m increasing.  Some  results  can  be  obtained  alge- 
braically for  p = 0,oo  j e.g.,  the  weight  of  for  the  D-optimum 

designs  on  a cube  with  support  on  E,  U E , U E is  equal  to 

1C  in 

[m(m-l)/(  (m-k)  (m-k-l)} ] [4/(  (m+2) (2m+3  )}  + 0(m  ^)]  , 


the  wei^t  of  E^  for  the  D-optimum  designs  of  S^(k,a)  with 
k+a  < m-l+a^  is  N and  for  the  E-optimm  designs  with  support 
on  ^0  (ki+5 )/{5 (m+l)} • 

As  an  example  of  structure  behavior  the  optimal  wei^ts  = Ip(^;j5.) 
for  the  cube  were  listed  in  Table  2 by  Galil  and  Kiefer  (1977b). 


Of  interest- for  us  is  the  computation  of  such  values  Pcrit^*^^^^ 
that  for  p > 'l>p-optimum  designs  on  2^(k, a)  are  also 
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^^-optimum  on  a cube,  or  on  the  other  hand, 

Op -optimum  designs  on  S2^(k,a)  are  unique. 

can  be  found  now  from  the  conditions  p . , 

•^crxt 

The  values  of  Pp^^^(m,k)  for  3 < m < 8 


for  p < p . , (m,k) 
crit 

The  values  of  k (p) 


{m,k  (p))  < p < p . , {m,k 
' m — -^crit  m 


are  given  in  Table  2. 


(p)-i). 


Table  2. 


The  values  of  P (m,k). 

crit  ’ 


m 


t 

3 

4 

5 

6 

7 

m-1  00 

1.7 

0.89 

0.46 

0.38 

0.29 

m-2 

00 

00 

6.0 

2.4 

1.8 

m-3 

00 

CO 

7.0 

m-4 

00 

As  a typical  illustration  of  the  efficiency  behavior  in  our  problem 
on  a cube  the  matrix  of  ®q^(p)  g(p)  efficiencies  is  presented  in 

Table  3 • 


Table  3.  The  matrix  of  efficiencies  {$)  for  cube  when  m=5* 


p 

g(p) 

^0 

®0.1 

0 

100 

100 

99.6 

0.1 

95 

99.6 

100 

0.5 

81 

95 

97 

1 

69 

88 

91 

2 

57 

79 

81 

10 

45 

68 

70 

00 

31 

52 

54 

®0.5 

"1 

^2 

"10 

e 

00 

91 

73 

48 

25 

19 

95 

81 

57 

26 

24 

100 

96 

82 

45 

4l 

97 

100 

95 

61 

56 

90 

96 

100 

77 

72 

.79 

87 

95 

100 

88 

61 

68 

76 

89 

100 
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Tlie  numerical  solution  of  the  equation  for  s:  e(s)  = min{e  (s))  = 

q ^ 

max  minCe  (p))  (p^q  e R^)  gives  us  for  m = 4, 5,6,7  the  values  of  s 
p q ‘I 

and  e(s)  respectively  as  follows:  2.06,  2.25,  2.45,  2.54  and  0.80, 

0.77,  0.73,  0.71. 

ilius  the  performance  of  | is  probably  the  best  of  what  we  can 

s 

obtain  on  a cube  with  respect  to  family  0 < p < oo]  if  no  particular 

reasons  for  the  choice  of  criterion  are  given  and  we  restrict  considerations 

* 

to  designs  of  the  form  , 

If  the  value  of  g(p)  must  be  taken  into  account,  then  e(s)  coin- 
cides with  e (s)  and,  e.g.,  with  m = 5,  we  have  that  s = 1.4  and 
00 

e(s ) = 0.64. 

We  can  compare  the  results  for  the  cube  with  the  results  for  the 
region  Q (3.0),  for  which  all  3>  -optimum  designs  are  unique  with  the 
support  on  U E^.  In  Table  4 the  optimal  wei^ts  of  the  center  point 
are  given,  and  in  Table  5 are  the  efficiencies  with  respect  to  both  0,^(3 >0) 
and  cube. 

Table  4.  The  optimal' wei^ts  CC^  of  the  center  point  on  0,^(3, 0). 

P 0 0.1  0.5  1 2 5 10  00 

l/2l  .059  .102  .143  .196  .259  .291  1/3 
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Table  5*  Some  efficiencies  (^)  of  $ -optimal  designs  on  Q.  (3,0). 


p 

g(p) 

e^Cp) 

e^(p) 

eg  (p) 

e (p) 

00 

0 

100,38 

100,66 

83,56 

51,43 

15,15 

1 

81,38 

95,63 

100,79 

96,81 

45,45 

2 

75,36 

91,61 

98,77 

100,84 

61,61 

10 

61,33 

82,55 

90,71 

94,79 

88,88 

00 

57,31 

78,52 

86,68 

90,76 

100,100 

The  left-hand  number  is  the  efficiency  for  Q^(3,0)  and  the 
right-hand  number  is  the  efficiency  of  the  same  design  for  the 
cube. 


(5}0)  are  relatively  constant  in  their  efficiency  e (p)  firstly  with 
small  q and  secondly  with  large  p.  Also  of  interest  is  the  fact  that 
the  efficiencies  of  these  designs  for  the  cube  are  less  variable  than  for 
^m  • 


All  the  $p-optimum  designs  on  S^(k,0)  with  k/m  "far'"  from  one 
are  fairly  efficient  with  respect  to  any  compound  criterion  based  on  a 
convex  average  of  ^^-optimaJ-ity  criteria.  For  example  in  the  case 
^ir(5j0)  all  I*  with  p > 2 have  efficiency  more  than  0.99  relative 

Jr 

to  the  ^-criterion,  defined  as  follows:  $(0  = (l  )'''^ 

vj  -L  CO 

and  the  minimum  of  <E> -efficiency  is  equal  to  O.85  with  p = 0.  Thus 
an  integer  design  can  be  chosen  with  80  trials  at  points  of  and 

with  such  a number  of  trials  at  the  center  point  that  both  the  exact 
<T>p-optimality  for  some  p and  "average  goodness"  are  provided. 


2h 


These  results  can  be  obtained  algebraically  because  all  the  '3&^-optimum 
designs  on  2^(k,0)  with  k < (m+l)/2  have  the  same  simple  structure;  in 
general,  the  performance  of  the  designs  on  2j^(k;,0)  improves  as  k decreases, 
or  as  the  region  "approaches"  the  m-simplex. 

As  it  was  expected,  the  ball  exhibits  much  more  regularity.  The 
values  of  optimal  weights  and  were  computed  as  well  as 

the  efficiencies  for  some  values  of  p.  With  m fixed  cc^  is  monoto- 

p 

nically  increasing  from  2/( (m+l) (m+2)}  (at  p = O)  to  (m+2)/(m  +2m+2) 

(at  p = oo)  and  o:^  decreases  from  2m(m+3  )/i  (m+l)  (m+2)  } (at  p = O) 

to  m/ (m  +2m+2)  ( at  p = oo).  The  value  of  cc^  increases  from 

2 2 

m (m+3 )/( (m+l)  (m+2)  } (at  p = O)  to  some  maximum  (near  p = l)  and  then 
2 2 

decreases  to  m / (m  +2m+2)  (at  p = oo);  the  behavior  of  0:^^' s with 
respect  to  m is  adso  strongly  regular. 

The  designs  |*  appeared  to  be  remarkably  robust  in  their  efficiency; 

CO 

the  value  of  e^(oo)  monotonically  increases  with  q,  from  6q(“)  'to  1, 
and  it  was  shown  in  section  3«5  that  ^qC®®)  "^1  as  m -*■  oo;  ^^(oo)  is 
already  equal  to  O.871  at  m = 3* 

* z' 

The  characteristics  of  the  designs  are  given  in  Table  6 for  the 

ball  of  dimension  5* 
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5.  Integer  Designs 

Some  of  the  results  of  sections  3 and  4 may  be  implemented  for  the 
construction  of  integer  designs.  On  a cube  for  any  p nearly  $p-optimum 
designs  can  be  found  approximating  the  moments  of 

we  have  with  m = 5 nearly  A-optimum  design  with  32  trials  at  points 
of  and  40  trials  at  points  of  E^^  its  A-efficiency  being  equal  to 

0.996  and  the  other  efficiencies  being  close  to  those  of  In  the 

same  way  exact  integer  E-optimum  designs  can  be  constructed  for  any  m; 
e.g.,  with  m = 5 such  a design  has  80  trials  at  points  of  E^  and  40 


trials  at  the  center  pointj  with  m = 7 a design  approximating  of 

the  same  structiu’e  has  112  trials  at  points  of  a minimal  second  order 

symmetric  set  Ij^  (such  sets  were  defined  in  the  paper  of  Pesotchinsky, 

1975)  and  48  trials  at  the  center  point.  Ihe  set  Ij^  consists  of  seven 

subsets  E|^  n {x  |x^  | = 1,  1 < k < 4}  = each  of  them  is 

4 ^ 

2 -factorial,  with  the  following  groups  of  indices:  1,2, 3, 4;  l,4,5»6j 
1^6,7, 3;  2, 4,6,7;  2, 5,7,1;  3,4,7,5>  and  3, 5^6, 2.  The  digits  in  groups 
are  written  in  such  a way  that  the  first  three  of  them  correspond  to  the 
subsets  E^  (i^,  i^,  i^ ) of  the  set  1^  with  56  points,  used  by  Box 
and  Behnken  (1960b)  for  their  three-level  design. 

The  E-optimum  designs  over  points  of  E^  U ^ ball  have 

the  same  struct\ire  as  on  a cube. 

For  the  search  of  designs  on  a cube,  both  practicable  and  "good" 
with  respect  to  the  family  of  G-  and  ^^-optlmality  criteria,  we  used 
the  following  procedure. 

For  each  m by  the  study  of  known  symmetric  integer  designs  (Atkinson, 
1974;  Box  and  Behnken,  1960a,b;  Nalimov,  Golikova  and  Mkeshina,  1970; 
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Pesotchinsky,  1975)  'the  "basic"  sets  were  selected  and  the  addition  of 

some  (sometimes  duplicated)  sets  with  a small  number  of  points,  such  as 

Eq;  Ep,  was  considered.  With  m = 4,5^6  the  basic  sets  were  E^,  E^  P 

and  I T and  the  supplemented  sets  were  E^  and  E, : thus  we 

started  with  the  star  point  designs  (Atkinson,  1975;  Walimov  et  al. , 1970) 

and  DP,  DB  designs  (Pesotchlnsky,  1975)- 

For  m = 4 the  best  were  the  star  point  designs  with  the  set  Ep 

duplicated  two  or  three  times,  and  for  m = 5^6  the  best  were  the  designs 

with  the  basic  sets  I ^ and  the  supplemented  sets  Et  and  E^. 

For  the  integer  construction  on  a ball  we  can  note  that  the  values 

of  (the  measure  of  the  sphere)  and  r = "independent"; 

thus  we  can  have  = ct  /m  close  to  the  E-optimum  value,  and  r close 

to  the  D-optimvim  one,  providing  both  the  E-  and  D-  goodness  of  the 

design  (and,  consequently,  $ -goodness  for  any  p).  This  reasoning  can 

P 

be  supported  by  theoretical  arguments,  because  '^q(I)  depends  mainly  on 

r,  and  ^2*  considered  the  star  point  designs  for 

4 < m < 6 and  the  designs  over  points  of  Eq  U ^ ~ 

The  characteristics  of  integer  designs  on  a cube  and  on  a ball  are 

listed  in  Table  J.  (I^  for  a ball  denotes  a half -replica  of  the  2™ 

factorial  with  levels  + l/v/ra  and  the  minimal  second  order  sytnmetilc 

subset  of  Ej  (-111=7);  constructed  by  Box  and  Behnken  (I960a)). 

It  is  interesting  to  note  that  the  minimum  of  and  G-efficiencies 

of  optimal  designs  from  section  4 is  less  than  that  of  integer  designs 

s 

constructed  above,  but  the  latter  are  not  -optimum  for  any  p.  Also  we 

P 

may  note  that  the  variation  of  an  additional  set  or  number  of  duplications 
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enables  one  to  construct  integer  designs  with  improved  characteristics 
for  a particular  subset  of  a family  of  criteria. 

The  author  is  grateful  to  Professor  J.  Kiefer  for  encouragement, 
helpful  discussions  and  valuable  remarks. 
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